handle non-alpha prefix variable name in parquet #235
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
zolstein
pushed a commit
to zolstein/parquet-go
that referenced
this pull request
Jun 23, 2023
* optimize delta decoding * vectorize decoding of int32 delta blocks * vectorize decoding of int64 delta blocks * optimize delta byte array decoding * use plain.AppendByteArrayLength * Optimize delta decoding (part 2) (xitongsys#230) * improve testing of delta decoding * optimize decoding of 8 bits values * optimize decoding of 16 bits values * optimize decoding of 1 bit values * optimize decoding of 2 bits values * optimize decoding of 4 bits values * implement generic vectorized algorithm to unpack 32 bits integers * remove unused code * implement generic vectorized algorithm to unpack 32 bits integers from sizes 17 to 31 * implement generic vectorized algorithm to unpack 32 bits integers from sizes 26 to 31 * use VPAND from AVX2 rather than VPANDD from AVX512 * Update encoding/delta/binary_packed_decode_amd64.s Co-authored-by: Kevin Burke <[email protected]> * fix typos * Optimize delta decoding (part 3) (xitongsys#231) * optimize validation of delta length byte arrays * vectorize copy of delta length byte arrays * add more tests and benchmarks * add more documentation * simplify implementation * refactor delta byte array encodings * A little copying is better than a little dependency. * remove errno type * optimize validation of delta byte array prefix and suffix lenghts * optimize delta byte array decoding * got vet fixes * rename miniBlockPack => encodeMiniBlock * Update encoding/delta/length_byte_array_amd64.go Co-authored-by: Kevin Burke <[email protected]> * Update encoding/delta/length_byte_array_amd64.go Co-authored-by: Kevin Burke <[email protected]> * Update encoding/delta/length_byte_array_amd64.s Co-authored-by: Kevin Burke <[email protected]> * Optimize RLE decoding (part 4) (xitongsys#235) * add internal/bitpack * remove unused code in encoding/delta * optimize RLE decoding of int32 values using internal/bitpack * cleanup * fix purego tests * use bytealg.Broadcast to implement repeated sections * Update internal/bitpack/unpack.go Co-authored-by: Kevin Burke <[email protected]> * Update internal/bitpack/unpack.go Co-authored-by: Kevin Burke <[email protected]> * optimize decoding of levels with RLE encoding Co-authored-by: Kevin Burke <[email protected]> Co-authored-by: Kevin Burke <[email protected]> Co-authored-by: Kevin Burke <[email protected]> Co-authored-by: Kevin Burke <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.